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(57) ABSTRACT 

An interactive multimedia tour guide provides a user with 
packaged tours in a multimedia format that includes direc- 
tions and useful information about a selected tour. The 
packaged tours are composed of principle and ancillary 
points of interest. A user profile is developed which is used 
to generate a preference mask for the user. The preference 
mask is used to select only those ancillary points of interest 
that would be of most interest to the user. The selected tour 
is stored on a portable self-contained electronic system 
which includes a GPS navigation system and cellphone. The 
system includes voice recognition software and speech 
synthesis software to provide the user with a verbal interface 
That provides directions and information on various points 
of interest during the tour. Combined with optional camera, 
the interactive multimedia tour guide allows for rapid iden- 
tification and cdituig of pictures or videos made on a tour. 

42 Claims, 23 Drawing Sheets 
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INTERACTIVE MULTIMEDIA TOUR GUIDE premises. And that country inn that is so highly 

recommended, it requires reservations at least a week in 
advance — ^it is after all highly recommended. 

BACKGROUND OF THE INVENTION -^^ problem is not unique to wineries, of course. Those 

1. Field of the Invention ^ interested in history might enjoy a tour of Revolutionary 
The present invention generally relates to the field of ^ivil War batUe fields or historic houses. Others 

electronic tour guides and, more particularly, to an interac- interested m the great scenic wonders of the country might 

tive multimedia tour guide that includes packaged toure in a ^ National Parks. Again, for either 

multimediaformatandwhichprovidesdirectionsandusefiil «f ^^P^^^ ^^ere are a great many books to pore over 

information about a selected tour as the tour progresses, llie '° plottmg out a strategy of where to go and what to do. But no 

packaged touts are part of a Geographic Information System matter how carefully one may plan, something may be 

(GIS) database, and a selected tour is controlled by the omitted or a turn missed makmg an eagerly anticipated tour 

Global Positioning Satellite (GPS) system. The user inter- somethmg less memorable than had been anticipated, 

face includes voice recognition and speech synthesis to The problems are exacerbated when one contemplates a 

provide audible directions and prompts and to respond to tourof a foreign country, particularly when one is unfamiliar 

voiced commands. The interactive multimedia tour guide with the language. For many, the answer is a pre-packaged 

allows the user to modify the padcaged tour while in tour, typically on a crowded bus with a translator/tour guide, 

progress and, in addition, serves the function of a concierge On such a tour, one is herded with the mass like so many 

to identify dining and lodging options and to make reser- cattle firom one photo opportunity to the next without ever 

vations for the user. The flexibility of the interactive multi- ^ having the time the fully appreciate the historical signifi- 

media tour guide allows the user to begin a tour at any point cance or beauty of the place. Quite often on return home, 

and to change the tour as the spirit dictates, allowing the user when reviewing the pictures taken, the traveler wonders 

an unprecedented degree of freedom in their sightseeing. where some of his or her pictures were taken and what was 

Combined with optional still or video camera, the interactive the subject of the picture, 
multimedia tour guide allows for rapid identification and 

editing of pictures or videos made on a tour. SUMMARY OF TOE INVENTION 

2. Background Description It is therefore an object of the present invention to provide 
Sightseeing has become an abiding pastime for many an interactive multimedia tour guide which provides a user 

people who are eager to see and leam about new things. To 30 an experience equivalent to having a personal tour guide, 
take advantage of this, many tour book authors and pub- jt is another object of the invention to provide an inter- 
Ushers have generated a vast amount of information to assist active multimedia tour guide which is portable, allowing the 
Uic eager travelers. Most big cities have tour buses witii tour user to carry the interactive multimedia tour guide with them 
guides that provide a running commentary on notable build- fool, on a bicycle, or in an automobile or other convey- 
ings and events as the tour bus passes through various 35 ance. 

sections of the cily. Sometimes it is possible to hire a f^^i^^^ invention to provide an 

knowledgeable tax. cab dnver to prov.de a more pe.sonal j^^.^^tive multimedia tour guide which allows the user 

tour of a city However, once outs.de the c.ty, the tounst ,s j^^^ j^j^, , ^^ 

more or less left to his or her own devices guided only by also durine the trio 

one or more of the many tour books available on the market. 40 , . . .. * . . 

This can be a problem because on the one hand there is a . ^ another object of the mventioii to provide an 

large amount of information and on the other hand a dearth interactive multimedia tour guide which allovs^ the user a 

of information. It is often difficult to find just the information ^^^'^^ ^^"g^^S^ ^o mteract with the tour guide 

needed for a particular tour. The information may be there in ^^'^^y Providing the user with the equivalent of a translator, 

all those tour books, but it is buried and hard to find. 45 It is still a further object of the invention to provide an 

Cbnsider an example. Suppose that a couple wanted to interactive multimedia tour guide which includes an optional 

take a nice day U-ip to visit several wineries in the region. ^^8*1^1 ^^^^^^ connection so that a picture or video taken 

Assuming that there are a number of wineries, the question the camera will be automatically date and time stamped 

arises, which ones to go to on this particular day trip? How and provided with the location and a brief description of the 

many can we see, and what else mi^t be in the same general 50 subject of the picture . 

locale that might be of interest? Is there a country inn where According to a preferred embodiment of the invention, 
lunch or dinner might be enjoyed? And if we were to spend the interactive multimedia tour guide is implemented using 
two or more days in the wine country, are there bed and a GPS (Global Positioning Satellite) system enabled map 
breakfasts or otiier suitable lodging? Qearly, by the time one program with a GIS (Geographic Information System) data- 
researches all these topics and determines where to go, what 55 base running on a computer. Tour data are prepackaged and 
to see and, if dining and lodging is desired, where to eat and stored on computer readable media, and this data may be 
stay, it is quite possible that something more famiUar not correlated to a hard cover book that describes the tours. The 
requiring all this work will be the alternate choice. But even data may be updated online by down loading data from 
if one were to undertake the logistical planning involved, Internet Web sites prior to taking a tour. In addition, for those 
tiicre are inevitably surprises. The hours listed in the tour 60 destinations having a Web site, the interactive multimedia 
book have changed since the book was published, there are tour guide may access that Web site via a wireless phone, 
fees that had not been anticipated, and that picnic you had such as a cell phone, on approach to the destination as 
planned to have at one of the wineries for which you had determined by the GPS system, 

purchased the nice loaf of French bread and the cheese to be The interactive multimedia tour guide can be used in 

enjoyed with the wine you were going to purchase, well the 65 several ways. First, the interactive multimedia tour guide 

winery does not allow picnics on the property or does not can be used in a home computer system to preview tours, 

have the required off license for you to consume the wine off much as a hard cover book equivalent would be used, by 
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accessing the GIS database. One advantage over a bard tour guide is a private automobile, the speakers of the 
cover book is that the computer system can be connected via automobile's stereo system may be used, and for those 
the Internet to a Web site that will provide the latest automobiles with integrated GPS systems, the GPS receiver 
information on the destinations in a tour being reviewed. can also be used. It is even possible to fully integrate the 
Such information might include opening times, admission 5 computer system in the automobile, but this is not necessary 
prices and discounts, amenities, and the like which may as a portable or laptop computer system or a pocket corn- 
change from time to time and season to season. The text of puter system or PDA may be used, allowing the interactive 
the tour description includes hyperlinks to those destinations multimedia tour guide to be easily transferred from one 
having Web sites so that the latest information provided by automobile to another or carried by the user. This portable 
the destinations themselves may be accessed The user can jq electronic system can be easily moved from one automobile 
select a tour and, by means of a print icon displayed on the to another, avoiding the incompatibilities of various propri- 
computer screen, open a menu to select a print out of a map etary integrated GPS navigation systems in different makes 
of a tour and printed text description of tour highlights, as of automobiles. Moreover, a user might fly to a particular 
updated by access to one or more Web sites. With this destination and use the interactive multimedia tour guide in 
information, the user may then go on the selected tour. a rental car. 

However, rather than print the tour, the user can download In a preferred embodiment, a special purpose portable 

the tour to a Personal Digital Assistant (PDA) having an electronic system implementing the interactive multimedia 

attached GPS module. Now the user is able to take the tour tour guide is provided. This system can be used while 

using the convenience of the PDA with the added guidance touring on foot or bicycle as well as in an automobile. In 

provided by the GPS module. 20 ^^^^i^ioD GPS system, this portable electronic system 

All the tours include various other points of interest in includes an integrated wireless mobQe telephone communi- 

addition to the primary destinations in a given tour. The cation system, such as a cell phone or other personal 

primary destinations are referred to as principle points of communication service. 

interest. These are the "backbone" of the tour; that is, other In this second mode of operation, the portable electronic 

points of interest hang on this backbone. The other points of js system displays a map of the selected tour and the location 

interest are referred to as ancillary points of interest and also of the GPS receiver (i.e., the location of the user or the 

wotild be identified on the printed tour map and accompa- automobile) on the map. Once a tour is initiated, the portable 

nying text. The user has the ability to customize the tours to electronic system displays a map, showing the user's current 

his or her own personal preferences. The interactive multi- location, and provides audible directions en route. For 

media tour guide provides a series of menus that seeks to 30 greater map detail, the user can voice the command "ZOOM 

develop a profile of the user as well as direct answers to the IN" to better show the immediate surrotmdings of the user's 

user's personal likes and dislikes. This might occur in the current location. This command can be repeated multiple 

process of loading the interactive multimedia tour guide on times, to the limit of the resolution of the map. Likewise, the 

the user's personal computer for the first time, but might be user can voice the command "ZOOM OUT' to provide a 

subsequently updated at any time by the user, perhaps to 35 better perspective of the user's location on the selected tour, 

include the preferences of a traveUng companion. Thus, Similarly, the voiced commands "PAN RIGHT', "PAN UP", 

while there may be a great deal of information in the etc. can be used to pan the displayed map in a desired 

database of the interactive multimedia tour guide about direction. 

many anciUary points of interest which are not the primary En route, the portable electronic system also provides 

subject of a particular tour, only those ancillary points of 40 audible descriptions of ancillary points of interest, offering 

interest which correspond to the preferences of the user, or the user the option of visiting any of the ancillary points of 

the user and the user's companion(s), would be included in interest. The user can alter the tour in progress by voicing the 

the printed map and accompanying text, command "DIRECTIONS" followed by any one of the 

The user is not confined to one of the prepackaged tours principle points of interest on the tour. The computer system 

in the database. For those not particularly familiar with an 45 responds to this command by activating the speech synthesis 

area, the prepackaged tours make an ideal choice, but for system to provide audible directions from the user's current 

those more adventurous, it is also possible to craft a cus- location to that point of interest, thereby allowing the user to 

tomized tour. This is done by previewing two or more of the modify the tour at will. In addition, there may be amenities 

prepackaged tours. When a tour is previewed, the principle along the route, which are not specifically in the tour or even 

points of interest are displayed in a slide show comprising 50 mentioned during the tour, for which the user may require 

still pictures and possibly video and audio clips to give the directions. An example might be the currently closest fast 

user an idea of what he or she will experience on the tour. food establishment to satiate the appetites of young children 

After previewing two or more prepackaged tours, the user in the automobile. The map database contains such 

may want to mix and match principle points of interest from information, and the computer system can provide the 

several tours to generate his or her own customized tour. 55 audible directions when requested. 

This is done by means of a menu which shows the several On approach to a destination on the tour, the computer 

principle points of interest which have been previewed with system, activated by distance information from the GPS 

a box to check (or uncheck) in order to select the principle system, activates the speech synthesis system and the text to 

points of interest the user would like in his or her lour. speech module 10 give the tiser a description of what he or 

Once a tour has been selected, however, a second way the 60 she is about to see and do. If the interactive multimedia tour 

interactive multimedia tour guide can be used is on the tour guide is used in an automobile, the occupants would hear 

itself. A GPS receiver and GPS enabled map program are this information on the speaker system. This information 

required. To support the full range of user interaction with might include a brief history of the place, significant facts, 

the computer system, the computer system also requires a personalities and amenities. This information may include 

microphone, speaker, a voice recognition system, and a 65 spoken or audible information and video chps. However, for 

speech synthesis system with a text to speech module. Since safety sake, if used in an automobile, video clips are 

one preferred environment for the interactive multimedia inhibited while the automobile is in motion. For example, on 
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a winery tour, the history of the winery to be visited, the a hat, to be less conspicuous, or worn independently. In 
proprietor and the winemaker, and types of grapes grown addition, if the user does not speak French (or other lan- 
and wines produced might be described. A video clip in this guage of the country or city visited), the interactive multi- 
case might be a brief interview with the proprietor and/or media tour guide includes a database of languages, allowing 
winemaker and show the harvest, crush and pressing opera- 5 the user to choose the language with which to interact with 
tions. If the destination has a Web site and the computer j^e tour guide. This database is also used to assist the user 
system is connected to a cell phone, the Web site can also be conversing with locals by providing translations of com- 
automatically accessed, again triggered by location as deter- ^^^^ pj^^g^^^ j^-^ ^^^^ both audibly and by 
mined by the GPS system. ^ ^^^^^^ ^^^^^^ written with a stylus on the hand-held display 
AparUcular advantage of the interactive multimedia tour ^^^^-1^ includes an integrated Personal Digital Assistant 
guide is the possibility to deviate from the selected tour. (PDA) function 

When Ae interactive multoedktoir guide d^^ The interactive multimedia tour guide may optionaUy 

the GPS position data that an anciUary pomt of interes j^^,^^^ ^ connection to a digital camera. When activated, a 

which corresponds to the preferences of the user say a Cml .^^^ ^.^^ ^^^^ 

War batUcfield site or other historical site is close by the „ {j^^ ^ ^ ^^^^^^^ ^^^i^^^ ^^^^^^^^ 

mteracttve multimedia tour guide wil notify the user of the ^ ^^^^ description of the subject of the picture. When 

site and mqmre whether the user would hke to deviate from -^^^^^ ^ downloaded to the user's personal com- 

the current tour to visit the site Should the user decide to ^^^^^.^ ^ ^^^^ ^.^^^ ^ 

visit the at^ he or she would respond with the voiced ^^.^^^^ j,^^^^^^ information about the picture or video is 

response "YES . The interactive multmiedia tour guide ^ jnchided with each piclwe or video clip. Tlie pictures may 

would then provide directions and commentary about the ^.j^^ ^ 

or video which may be edited on a personal 

site. Once the site had been visile^^^^^ would then ^ ^^j^.^- presenUtion. 

voice the command "RETURN TO TOUR", and the inter- ./ .„ . % *u • -c ♦ <r * 

w A' ♦ M u .'A ^ ^^♦•^^c It will be appreciated that one of the significant features 

active multimedia tour guide would provide the directions to r*u • . j- * -a ^Zu -um-* e 

return to the original tour mleracUve mulUmedia lour guide is the possibiuty of 

. . 1 / .t. . 1 u * * modifying the tour while en route. This ad hoc feature makes 

In another scenano. let us assume that a couple has set out interactive multimedia tour guide very much like a 

on a selected day tnp to tour several wineries. As he day ^^^^ ^^^^ concierge. And while the 

weaK on, they might decide that it would be nice to have ^ embodiment contemplates the primary use of the 

lunch or dmner at an mn or restaurant in the vicmity ^^^^^^^^ mulUmedia tour guide in an automobile, the 

OrdinaiUy Uiis m^^t pose a problem tmless they and 30 ^^^^^^ ^^^^^ interactive multimedia tour guide 

anucipated the possibili y and detemined where sach an inn ^^^^^ pedestrian touis quite practical. Hiis is a particular 

or restaurant inight be located With the interacUve mulu- ^^^^^^^ ^j,^^ touring foreign countries in which user is 

media totir guide, such pnor planning The ^^^^^ ^ ^ Obviously, a combina- 

'^'f^Fc^r.nA'f u*f DINING' or. more ^^^^ pedesSian tour is also possible with 

simply, "FOOD", but of course the latter voiced command 35 interactive multimedia tour guide, 
could be used to find grocenes for, say, a picmc. The 

interactive multimedia tour guide searches its database and BRIEF DESCRIPTION OF THE DRAWINGS 

identifies those establishments which are reasonably close, foregoing and other objects, aspects and advantages 

lliese are then read to the user, providmg distance and an ^^^^^^ understood from the following detailed 

approximate time of arrival, type of cuisine, dress 40 description of a preferred embodiment of the invention with 

requirements, and whether reservations are recommended or ^ference to the drawings, in which: 

required. Should reservations be recommended or required ^ • ui 1 j- * 1 * * 

I.J , * , „ „ vL FIG, 1 is a block diagram of a personal computer system 

for a selected inn or restaurant, the user can voice the u- l *u • * i*- j- * -a u 

^ «r-AT T» t uToU Jt^%^^Ur.r^^ iVv* which the mteractive multimedia tour gmde may be 

command CALL to establish a telephone connection tor • ^ j r *l c • • j 1 ^- . 

CI- installed for the purpose of previewing and selectmg tours 

the purpose of makmg reservations. 45 , . « j-*- • *, * 1 j • * 

.f , , , , . , . . £c . .1 . t-, ... . ™, optionally, editing pictures taken durmg a tour; 

Similarly, should the day tnp be sufficiently enjoyable that rii^ • a . • , - 

the couple decides that it would be nice to extend the trip for /J^' 2 is a flow diagram showing the logic of the process 

another day, the user of the multimedia tour guide can voice determimng a user s preferences m order to generate a 

the command "FIND LODGING", and the interactive mul- Pffi'^^^^ ^"^^ ^^"^^^^ pomts of mterest from the 

timedia tour guide will search its database to identify those 50 uaiauc«o, 

bed-and-breakfasts, motor lodges, camp grounds, and the ^I^S. 3A to 3E, taken together, form a flow diagram 

like which are reasonably close or perhaps close to another showmg the logic of the process of previewmg tours for 

selected tour to be taken on the following day. As before, the selecUon, customization, updating information in the daU- 

interactive multimedia tour guide would provide distance ^^er selection and/or customization, prmting a 

and approximate time of arrival for each establishment 55 ^^^^^^^ °^^P accompanying text; 

identified. The user would again voice the command FIG- 4 is a pictorial representation of a personal digital 

"CALL" to establish a telephone connection for the purpose assistant (PDA), with attached GPS receiver, to which a 

of making reservations. selected or customized tour may be downloaded; 

The portable electtonic system implementing the interac- FIG- 5 is a pictorial representation of a portable sclf- 

tive multimedia tour guide, being sufficiently portable, can 60 contained electronic system implementing the interactive 

be used while touring on foot or while touring on bicycle, multimedia tour guide according to a preferred embodiment 

say in a city such as Paris where there are many sights to see the invention; 

most advantageously while walking rather than in an auto- FIGS. 5A and SB are pictorial representations of the 

mobile or a bus. To best use the interactive features of the portable self-contained electronic system housed in a unitary 

invention in this environment, a lightweight headset con- 65 stmcture; 

taining a miniature microphone and earphone may be worn. FIG. 6 is a block diagram of the computer architecture for 

The headset could be integrated into a pair of sunglasses or the system imit of the portable self-contained electronic 
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system implementing the interactive multimedia tour guide The ICH 108 also provides a low pin count (LPC) 

shown in FIG. 5; interface to a super I/O device 119 supporting a keyboard 

FIG. 7 is a pictorial diagram showing the relationship of 150, mouse 151, floppy disk drive 152, and parallel and 

the GPS system and a personal communication system to the serial ports 153 and 154, respectively. The keyboard and 

portable self-contained electronic system of FIG. 4; s mouse connections may be either through the IR transceiver 

FIGS. 8A to 8C, taken together, form a flow diagram 125 or the PS/2 ports 143 and 144, respectively, 

showing the logic of the process of taking a selected and/or The interactive multimedia tour guide includes a GIS 

customized tour which has been stored in or downloaded to database including many points of interest. In many printed 

the portable self-contained electronic system shown in FIG. tour guides, the various points of interest will the rated by 

6; 10 the author of the lour guide in an order of importance. This 

FIGS. 9 A to 9D, taken together, form a flow diagram might be, for example, by using a series of stars next to the 

showing the logic of the process for finding suitable dining point of interest with, say, four stars indicating the most 

and lodging while taking a selected tour; and important sights and no stars indicating only passing inter- 

FIGS. lOA to lOD, taken together, form a flow diagram est. While there is general agreement among audiors of 

showing the logic of the process for date, time, location, and is printed tour guides about ratings of many points of interest 

orientation stamping pictures and videos as well as adding (e g * Westminster Abbey in London universally rates four 

an identification and dcsCTiption of the subjects of the stars), inevitably the ratings reflect a particular author's own 

pictures and videos. personal prejudices. If we were to hire a personal tour guide 

in a particular city, that tour guide would also provide a tour 
20 based on his or her prejudices. The prejudices of an author 
or personal tour guide may not correspond to the preferences 



DETAILED DESCRIPTION OF A PREFERRED 
EMBODIMENT OF THE INVENTION 



Referring now to the drawings, and more particularly to of one going on the tour. What would be desirable is to 

FIG. 1, there is shown a computer system architecture on interview the tourist to find out his or her personal prefer- 

which the interactive multimedia tour guide may be installed ences in order to show the tourist those things that may be 

for the purpose of previewing, selecting and customizing 25 of the most interest to him or her. The interactive multimedia 

tours. The computer system includes a central processor unit tour guide according of this invention does this, as shown in 

(CPU) 100 connected to a memory controller hub (MCH) FIG. 2, to which the reader's attention is now directed. 

101 via a system bus 102. The MCH 101 is connected to a fig. 2 is a flow diagram showing the process by which the 

random access memory (RAM) 103 via a direct memory bus user's preferences ar« determined. From these preferences, 

104, such as a bus meeting the Rambus specification, and a 30 a preference mask is generated. This preference mask is used 

video graphics chip 105, such as the accelerated graphics to make a selection of those ancillary poinU of interest that 

port (AGP) graphics chip, via a video bus 106. A display may be most interesting to the user. This process is done on 

screen 140, such as a liqiiid crystal display (LCD), is initial program load, but may be done again at a later time, 

connected to the AGP graphics chip 105. cither to update the user's preferences or to include the 

The MCH 101 is further connected via high speed inter- 35 preferences of a traveling companion. The process starts in 

face 107 to an input/output (I/O) controller hub (ICH) 108. function block 201 which displays a screen in which the user 

The ICH 108 provides connection to a personal computer is prompted to enter information about himself or herself 

interface (PCI) bus 109, to which is attached one or more This information may include, for example, the user's age, 

PCI slots 110 for option cards, an integrated device elec- gender, ethnic origin, level of education, field of education, 

Ironies (IDE) controller interface 111, to which a hard drive 40 vocation, hobbies, special interests, and the like. This is the 

112 and a removable media drive 113, such as a compact objective data used to generate a profile of the user which, 

disk/digital video disk (CD/DVD) drive, are attached, a in turn, is used to select those ancillary points of interest 

universal serial bus (USB) controller 114 connecting to the which may be of most interest to the user. Since this 

USB ports 141 and 142, and a firmware hub (FWH) 115. information may be considered sensitive to the user, the 

Operating system (OS) software is installed on the hard 45 variousfieldsmay be made optional, allowing the user to opt 

drive 112. Voice recognition and speech synthesis software out of entering the information. However, to provide the best 

also may be installed on the hard drive 112, but this is not tours for the user, it is preferable to encourage the user to 

necessary for the purposes of previewing and selecting a input the information, which may be encrypted and securely 

tour. The ICH 108 integrates a local phone network port and stored so that the information may not be accessed when a 

an Ethernet network port in local area network (LAN) 50 Web site is accessed on the Internet. In decision block 202 

connection 116. The ICH 108 also provides an interface to a test is made to determine if all the information requested 

a multiple channel audio interface 117, to which microphone has been entered or, optionally, whether the user has entered 

126 and speaker 127 and stereo speaker jacks 146 and 147 all the information he or she desires to enter and opted not 

and headphone and microphone set jack 148 are connected. to enter certain other information. If not, the process waits 

The ICH 108 interfaces with a modem 118 for optional ss in function block 203 until the user has completed entering 

connection to the Internet. This may be by dial-up connec- profile information. When the user has completed entering 

tion via telephone 149, or the modem 118 may be a cable profile information, the process then goes to function blod 

modem or other interface to the Internet. 204 which displays another screen in which the user is asked 

If the interactive multimedia tour guide is distributed on to rate various types of points of interest, such as museums, 

removable media such as a CD or DVD, the supporting 60 parks and gardens, historic houses, amusements, types of 

software is first installed on the hard drive 112 and the restaurants and lodgings, etc. This rating system may be, for 

content read from the removable media. In the alternative, example, on a point system of one to five, with five indi- 

the interactive multimedia tour guide may be down loaded eating a high interest and one indicating a low interest. This 

from the Internet and stored on the hard drive 112. It is is the subjective data used to generate the profile of the user 

possible, for example, for the hard drive to store multiple 65 which, in turn, is used to select those ancillary points of 

interactive multimedia tour guides, and the computer system interest which may be of most interest to the user. In other 

woidd be a repository or library of totu^ guides. words, both objective and subjective data is used to generate 
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the user profile. A determinadoii is then made in decision 
block 205 as to whether the user has completed rating the 
various types of points of interest and, if not, the process 
waits in Unction block 206 until the user completes the 
rating process. Once the rating process is completed, the 
information input by the user is analyzed in function block 
207 to generate a user profile. The process of analyzing the 
user's profile may include an expert system. The result of the 
analysis is then used to generate in function block 208 a 
"mask" of preferences that will later be used to select 
ancillary points of interest to be presented to the user on a 
selected tour, along with the principle points of interest. This 
mask of preferences is then stored in function block 209 on 
hard drive 112 of the computer system shown in FIG. 1 for 
later access. The user may wish to include one or more travel 
companions who may each go through the process shown in 
FIG. 2, in which case there would be separate masks of 
preferences for each such travel companion and these would 
be stored on the hard drive 112 for later access. Thus, in the 
process of selecting a tour, the user may indicate that he or 
she is traveling with one or more companions, each having 
a stored mask of preferences. As wiU be seen in the selection 
process shown in FIGS. 3 A to 3E, these various masks of 
preferences will be accessed to determine the points of 
interest selected &om the GIS database for presentation 
during the tour. 

In the GIS database according to the preferred embodi- 
ment of the invention, points of interest are rated as principle 
points of interest, ancillary points of interest, and amenities. 
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suppose the tour guide were for wineries. The state or 
country or region which is covered by the tour guide would 
be divided into geographical locations, e.g., north east, 
south, etc., and within each grouping by geographical loca- 
tion would be a number of pre-packaged tours of, say, three 
wineries which could be selected as a day trip. In another 
example, suppose the user were plarming a trip to Paris and 
hoped to sightsee in both the city and its environs. In this 
case, tours might be grouped by geographical location, say 
quadrants, within the city and by day trips out of the city. 
Rather than geographical location, the suggested tours might 
be grouped according to theme; e.g., politics, art, history, 
etc. Of course, other groupings of selected tours are also 
possible. In any case, the user would be prompted to select 
one of the groups of tours. A determination is made in 
decision block 302 as to whether a group of tours has been 
selected and, if not, the process waits in function block 303 
until a selection has been made. Once the user makes a 
selection of a group of tours, the process goes to function 
block 304 where a screen is displayed showing the sug- 
gested tours in the selected group. Again, the user is 
prompted to make a selection of one of the suggested tours. 
A determination is made in decision block 305 as to whether 
the user has selected one of the displayed suggested tours 
and, if not, the proceiss waits in function block 306, When 
the user selects a suggested tour, a slide-show presentation 
of the principle points of interest for that tour is accessed and 
displayed to the user in function block 307. The presentation 
may include a map of the tour, still pictures and video and 



However, it will be understood by those skilled in the art that 30 audio clips to better provide the user with a preview of what 



a different rating system or more or less levels of rating 
could be used in the practice of the invention. The principle 
points of interest are the "backbone" of a suggested or 
prepackaged tour. So, for example, on a tour of Washington, 
D.C., having an emphasis on government, principle points of 
interest could be the U.S. Capital, the White House, and the 
Supreme Court, representing the three branches of the 
Federal Government. The ancillary points of interest are 
which might be of interest in this tour might be the National 
Archives where the Declaration of Independence and the 
U.S. Constitution are housed and on display, the Federal 
Bureau of Investigation (FBI) building, and the Library of 
Congress. The amenities in this tour could be various places 
to eat, such as restaurants and cafeterias, and possibly hotels 
if one were to decide to spend the night. Different tours 
would have different principle points of interest and corre- 
spondingly different ancillary points of interest. While the 
tour just described is centered about the Mall in Washington, 
D.C., this is also the area of many of the Smithsonian 
Museums. So another tour emphasizing history and tech- 
nology could have as principle points of interest the 
Museum of American History and the Air and Space 
Museum, and a tour emphasizing art oould have as principle 
points of interest the National Gallery of Art (the Mellon 
Gallery), the Hirshom Museum, and the Freer Art Gallery, 
and so on. However, as will be described, suggested or 
prepackaged tours are just that — suggested. The user of the 
invention is provided with option of selecting principle 
points of interest from several prepackaged tours to generate 
a customized tour, however eclectic it may be, that satisfies 
the user's interests. Indeed, the user may select an ancillary 
point of interest and make it into a principle point of interest 
for his or her own customized tour. 

1\iming now to FIG. 3 A, the process of selecting a tour 
begins at function block 301 where a screen is displayed 
showing the various tours grouped in some fashion, as for 
example by geographical location or theme. To illustrate, 
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is in store if this tour is finally selected as the tour the user 
wants to go on. At the end of the slide-show presentation, the 
user is given several options. In decision block 308, deter- 
mination is made as to whether the user has made the 
previewed tour his or her final selection. If not, the user has 
the option of returning to the screen displayed in function 
block 304 to select another tour to preview, and this is 
detected in decision block 309. The user also has the option 
of selecting one or more of the principle points of interest of 
one or more previewed tours to make his or her own 
customized tour. This is detected in decision block 310, in 
which case a list of those principle points of interest which 
have been viewed in the previewed tours is displayed to the 
user in function block 311. This display includes boxes to 
check (or uncheck) in order to select the principle points of 
interest which the user would like to have included in his or 
her customized tour. The user is then prompted in function 
block 311 either to select the customized tour, return to the 
suggested tours in function block 304, or to exit the process. 
The first option is detected in decision block 312, in which 
case the customized tour is stored in function block 313 and 
the process goes to function block 315 in FIG. 38. The 
second option is detected in decision block 309, in which 
case the process goes back to function block 304; otherwise, 
the option of exiting is detected in decision block 314. If the 
last choice is chosen by the user, the process ends 

Should the user select a suggested tour, as detected by 
decision block 308, or a customized tour, as detected by 
decision block 312, the process goes to function block 315 
in FIG. 3B where the user is asked whether he or she will be 
accompanied by one or more travehng companions. If the 
user's answer is YES, as determined in decision block 316, 
then the user will be prompted in function block 317 to input 
the name or names of their traveling companion or 
companions, and if the computer does not have a traveling 
companion's name in its database of preference masks as 
determined in decision block 318, the user will be asked in 
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function block 319 whether a preference mask should be interest which the user has checked (or unchecked) is 

generated for the traveling companion. If the user's response acceptable. If not, as determined in decision block 329, the 

is YES, as determined in decision block 320, the process will process goes to FIG. 3D where the user is asked in decision 

suspend and exit to the process shown in FIG. 2 in order to block 330 if additional points of interest are desired. A 

generate a preference mask for the traveling companion. If 5 determination is made in decision block 331 as to whether 

the user is not traveling with a traveling companion, as the user would like to review additional ancillary points of 

determined in decision block 316, or if any and all travel interest not included in the custom set of ancillary points 

companions identified are in the database of preference interest generated using the composite preference mask. If 

masks as determined in decision block 318, or if the user so, in function block 332, additional ancUlary points of 

decides that a preference mask should not be generated for interest are displayed with boxes which may be checked (or 

a traveling companion, as determined in decision block 320, unchecked) to include in the lour. The user is again prompted 

the process next goes to function block 321. in this display as to whether the custom set of ancillary 

In function block 321, a composite preference mask is points of interest is acceptable. If not, as determined in 

generated. If the user is traveling alone, the composite decision block 333, the user is given options. The first 

preference mask is simply the user's preference mask, but if ^5 option, detected by decision block 334, is that of returning 

the user to be accompanied by one or more traveling to the original screen displayed in function block 324 (FIG. 

companions, the composite preference mask is generated as 3C). The second option, detected by decision block 335, is 

a function of all the preference masks. The simplest function that of exiting. Should the user choose to exit, the process 

is the Boolean OR function, but more complex functions ends. When the user is satisfied with the custom set of 

may be used to generate the composite preference mask. For 20 ancillary points of interest for the tour either as originally 

example, there may be certain likes and dislikes of the user generated, as determined in decision block 327 (FIG. 3C), or 

and his or her traveling companions which may be weighted as modified by subtraction, as determined by decision block 

so as to cancel a particular preference in one or the other of 329 (FIG. 3C), or addition, as determined by decision block 

the preference masks used to generate the composite pref- 333 (FIG. 3D), the process goes to function block 336 in 

erence mask. Suppose that the user and his or her traveling 25 FIG. 3E. 

companion are touring Vienna and that the user is an in function block 336, a screen showing the tour selected 

afBcionado of opera and his or her traveling companion has displayed. The tour includes the principle points of 

but litde interest in opera but is interested in the culture of interest and a custom set of ancillary points of interest, the 

the city, then it may be that one of the ancillary points of custom set being generated by the process just described. As 

interest to include in the tour is the opera house. On the other 30 mentioned, the principle points of interest of the suggested 

hand, suppose that the user and his or her traveling com- the tour are the "backbone" of the tour. The display produced 

panion are touring Madrid and that the user is strongly in function block 336 includes several icons; a Web icon, a 

opposed to cruelty to animals and his or her traveling print icon and a download icon. If the Web icon is selected, 

companion has a broad interest in sports, then it may be that as determined in decision block 337, the principle points of 

the football (soccer) stadium would be one of the selected 35 interest are checked to determine if they have Web sites on 

ancillary points of interest but not the bull ring. the Interact. Those that do will be displayed with their 

Once the composite preference mask is generated, the Universal Resource Locator (URL) in function block 338. 

process goes to FIG. 3C where the GIS database is accessed This display can be conveniently located in a left hand 

in function block 322 to access all the ancillary points of window of the display screen much the same as the search 

interest for the selected or customized tour. The composite 40 results are displayed when a search engine is used to search 

preference mask is then used in function block 323 to on the Internet. By clicking on the URL for a particular 

generate a custom set of ancillary points of interest for the principle point of interest, as determined in decision block 

user and his or her traveling companion(s). A list of the 339, the user's computer accesses that point of interest's 

custom set of ancillary points of interest may then be Web site through the user's Internet Service Provider (ISP) 

displayed to the user in function block 324, each point of 45 in function block 340. The Web page for the selected point 

interest being linked with a brief statement describing the of interest can be conveniently located in a right hand 

point of interest in a cartoon bubble. By placing the pointing window of the display screen. This provides the user with an 

cursor over one of the displayed ancillary points of interest opportunity to update the tour database to include any 

in the custom set of ancillary points of interest, as deter- changes in opening times, fees and the like in function block 

mined in decision block 325, this link is activated in function 50 341. After viewing a Web site, the user can click on the URL 

block 326 to display the brief statement describing the point for another point of interest to be connected to the Web site 

of interest in the cartoon bubble. Alternatively, the displayed for thai point of interest and, again, update the tour database, 

ancillary points of interest may be anchors for hyperlinks to When the user is finished viewing Web pages for the 

a more detailed explanations of the ancillary points of principle points of interest, he or she does so by clicking an 

interest, including possibly a slide show including video and ss EXIT button, as determined by decision block 342, which 

audio clips that provide a more in depth explanation of the returns the process to the display produced in function block 

ancillary point of interest. 336, In this way, the user can be assured of having the most 

Hie user is prompted in the display provided in function up-to-date information relating to the tour that he or she is 

block 324 as to whether the custom set of ancillary points of about to go on. The process can be extended to the ancillary 

intercstisacccptable. If not, as determined by decision block 60 points of interest. Alternatively or in addition to accessing 

327, the displayed list of ancillary points of interest provided the various points of interests' Web sites, there may be 

in function block 324 is modified in function block 328 to displayed the URL of the publisher of the interactive mul- 

include boxes which the user may check (or uncheck) to timedia tour guide in order to download more up-to-date 

exclude specific ones of the selected ancillary points of data for the selected tour. In this case, clicking on the 

interest from the custom set. The user is again prompted in 65 publisher's URL first connects to the publisher's Web site 

this modified display as to whether the custom set of and, once the user has logged into the Web site, the principle 

ancillary points of interest is acceptable with those points of points of interest of the user's selected or customized tour 
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are up loaded to the publisher's Web site where updated modified to include the additional functionality to support 

information is accessed and then down loaded to the user's the interactive functions. With the system shown in FIG. 5 

computer. This might be on a subscription basis. or FIGS. 5A and 5B, the user would coimect the portable 

If the print icon is selected, as determined in decision se]f*contained electronic system shown in FIG. 5 or RGS. 

block 343, the tour map is printed in function block 344 with s 5A and SB to the user's PC (FIG. 1) and click on the 

accompanying text including detailed directions to the prin- download icon. The coimection can be wired or wireless, the 

ciplc points of interest of the tour and ancillary points of former including, but not limited to, USB and IEEE 1394 

interest along the way. Also printed would be the amenities, ports, and the latter including, but not limited to, an infrared 

such as inns, bed-and-breakfasts, motor lodges, and camp (ir) port and a wireless access point. When the user clicks 

grounds as well as restaurants, cafeterias, fast food jq on the download icon, as detected in decision block 345, the 

establishments, convenience stores, and the like. At this selected tour, including the relevant parts of the GIS 

point, the user has a printed version of a custom tour which database, are downloaded in funcUon block 346. Notice that 

can be used conventionally. this down load is different than the down load just described 

As shown in FIG, 4, rather than print a hard copy of the for the PDA (FIG. 4) in that relevant parts of the GIS 
selected and/or customized tour, the user may instead down- ^5 database are included in this down load. This is merely a 
load his or her tour to a personal digital assistant (PDA) 40 matter of memory capacity, it being assumed that the PDA 
to which is attached a GPS receiver 41, such as the DeLorme memory capacity is less than that of the portable self- 
Earthmate™ GPS receiver for the Palm*^" PDA. This pro- contained electronic system shown in FIG. 5 and therefore 
cess is accessed by the print icon, the selection of which is not capable of storing all the relevant parts of the GIS 
detected in decision block 343. When the print icon is database. Obviously, as memory capacities increase for 
selected, the user is asked what printer to use, one of the PDAs, this distinction would not be necessary. By the same 
choices being the PDA. The PDA 40 has a liquid crystal token, if the memory capacity of the portable self-contained 
display (LCD) 401 and an area 402 for entering data using electronic system shown in FIG. 5 is sufficient, the processes 
the hand writing recognition convention of the specific shown in FIGS. 2 and 3A to 3E could be performed on the 
PDA. For this purpose, a stylus 403 is conventionally 25 system without need of doing so on the user's PC and down 
provided with the PDA for use on the area 402 to enter hand loading a selected tour. In other words, all the functions of 
written symbols. In addition to various conUrol buttons, the the interactive multimedia tour guide according to the inven- 
PDA 40 may also include a speaker 404 and a microphone tion may be performed on the portable self-contained elec- 
405, as is provided in the Compaq iPAQ™ pocket PC. The tronic system shown in FIG. 5. Finally, referring back to 
PDA 40 typically has an accessory jack 406 which may be 39 FIG. 3E, the user is given the option to exit in decision block 
used to provide a cable connection to the user's PC via either 347. When the user selects this option, the process ends, 
a serial or USB port. This accessory jack 406 can also, be xhe basic components of thejjfl£Uble self-contained 
used to co^cctjcw ocU. p ho.ne,_such^^thc^yo^ electronic system are shown irf^STs^rhese are a GPS 
(formerly'Qualcom)ceUphone^ receiver 51, a hand-held displa^NS^ra system unit 53, a 
tooMt^n^addifion, the PDA 40 typically has an accessory 35 wireless mobile telephone 54, such as a cell phone or other 
slot 407 f or receivingaflasbjnej norv 408. Altemativelv. the personal communication service, a power supply 55, a 
flash memory" may be^ internal to iBe unit. Additional carrying case 56, and an optional digital camera 57. Since 
memory cards 409, including language translators, may be this is an interactive system, there needs to be both micro- 
used in the accessory slot 407 The PDA 40 may be con- phone and speaker to permit the user to communicate with 
nected to the user's PC via a cable connection, as mentioned, 40 the interactive multimedia tour guide. The microphone and 
or via a wireless connection to an infrared (IR) port for speaker are also used for the telephone 54 in hands free 
purposes of down loading the tour. Aa^ntfifliw.410^is operation. For pedestrian tours, the microphone and speaker 
p rovided on the PDA fo r the wireless connection via a may be incorporated into an optional headset 58. The 
wifcicasaccc^jBO^ headset 58 may be integrated into a pair of glasses, say sun 
Once stofedm flash memory, the user is ready to go on the 45 glasses, or a hat, if desired to be less conspicuous when in 
tour widi the additional functionality of the GPS navigation use, or simply used as is. For automobile tours, the micro- 
system to guide him or her. phone may be incorporated into the display 52 and the 

The PDA 40 shown in FIG. 4 also may be provided with speakers may be incorporated into the system unit 53. When 
other accessories which will be useful to the traveler. A the headset 58 is being used, the microphone in the display 
digital camera accessory 42 may be added. An example is 50 52 and the speakers in the system unit 53 are disabled, 
the Kodak PalmPix'*^'^ digital camera for the Pahn PDA. The Optionally, the system unit may be provided with a low 
camera accessory attaches to the back of the PDA and uses power radio frequency (RF) transmitter which transmits at a 
the PDA's display 401 as a view finder for taking pictures. frequency in an unused portion of the amplitude modulation 
The camera accessory has a lens 421 and shutter release 422 (AM) or frequency modulation (FM) radio bands, allowing 
and can be provided with a card slot 423 for receiving an ss the user to tune the automobile radio to that frequency and, 
additional memory card 424 for storing pictures. Aparticular thus, use the speakers in the automobile. The power supply 
feature of this combination is that pictures taken with the 55 may include a battery, a battery charger and a 12 volt 
camera accessory 42 can be date and time stamped from the power adapter, the latter being used to connect to an auto- 
PDA's internal clock and, in addition, stamped with location mobile's power connector when used for an automobile tour, 
information derived from the attached GPS receiver 41. eo The display 52 may be provided with a clip allowing it to be 

The preferred practice of the invention, however, is to use attached to a vent or other convenient place on an auto mo- 

the principle points of interest with the custom set of bile dashboard or to the user's belt or the carrying case 56. 

ancillary points of interest for the selected tour in a mobile The display 52 is a convenient size to be hand held and 

or portable self-contained electronic system implementing includes a flat panel color display 521, such as a Uquid 

the interactive multimedia tour guide, as generally shown in 65 crystal display (LCD), and a set of control buttons, including 

FIG. 5 or, alternatively, in FIGS. 5A and SB. This can be a PDA/MAP mode button 522, a power on/off switch 523, 

done also with the PDA 40 shown in FIG. 4 provided it is a location button 524, a zoom in/out wheel 525, and panning 
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roller ball 526. Other manual switch functions could be 
provided or alternative switch arrangements used, but the 
intent here is to keep the user interface simple. In addition, 
for a built-in peisonal digital assistant (PDA) function of the 
display 52, a stylus may be provided to aUow the user to 
input information or make menu selections. The system unit 
53 incorporates a CD/DVD drive which is accessed by a slot 
531. Additionally, connections arc provided for each of the 
GPS receiver 51, the display 52, the cell phone 54, and the 
headset 58. The carrying case 56 has pockets to receive, in 
addition to the user's own travel accouterments, the GPS 
receiver 51, the system unit 53, the power supply 55, and 
accessories and may take any of several convenient forms 
including a small attache case, which would be suitable for 
moving the system from one automobile to another, or a 
small backpack, as shown, which would be suitable for 
pedestrian and bicycle tours. The optional digital camera 57 
includes a calendar/clock for date and lime stamping of 
digital image(s) or video clips, a built-in GPS receiver to 
provide location infomiation of digital image(s) or video 
clip(s) and a built-in digital compass to provide orientation 
information of digital image(s) or video clip^s). J[ie ^amera 
i s_provided_with-transceiver to allow communica t ionjadt h 
the sy stem unit 53. The transceive r o p erat es on an ind u st fv 
sl 'MSrS" such"~a s y ^^ BluetoottL standard^ however, the 
particular wireles^ is not critical to the prac- 

tice of the invention. 

An altemative to the camera 57 is a camera attachment 42 
for the PDA 40, shown in FIG. 4. Alternatively, the camera 
attachment 42 could be used on the display 52 shown in FIG. 
5. One possibility is that the PDA 40 be used as the display 
52. in which case, the display 52 would be detachable from 
the system unit 53 and the camera attachment added. In 
addition, a GPS receiver would be built into camera attach- 
ment 42 to provide substantially the same functionality as 
the optional digital camera 57. In order to provide orienta- 
tion information, the camera attachment 42 would addition- 
ally include a digital compass. If the PDA 40 is used as the 
display 52, it needs to be provided with the switch functions 
of the display. This can be most conveniently done in 
software to provide a display of switches performing those 
functions. Alternatively, the display 52 may be a specially 
designed PDA having all the functions of the PDA 40 plus 
the additional switch functions described. 

FIGS. 5A and 5B show an alternative implementation to 
the portable self-contained electronic system are shown in 
FIG. 5. This implementation is a unitary .structure based on 
an integrated PDA and cell phone technology, such as the 
Kyocera Smartphone"^" which combines the functionality of 
the Palm'^^ PDA with a cell phone. The unit 58 has a front 
flip out panel 581 which, when closed, as shown in FIG. 5A, 
looks l^e a standard cell phone. This panel carries the 
standard cellphone keyboard and has a window 582 through 
which an LCD screen can be seen. The standard cell phone 
display functions can be viewed through this window 582. 
There is, in addition, the standard speaker 583 and micro- 
phone 582. When the flip out cover 581 is opened 
downwardly, as shown in FIG. 5B, the LCD screen 521 of 
the PDA is revealed. This is the same LCD screen 521 of the 
display 52 shown in FIG. 5. By integrating a GPS recei ver 
into th e unit and in cotporating the controls of the 

display 52 shown^i^TlGT^^ ali ot the functionality of the 
pOTrtable^lf -contained electronic system are shown in FIG. 
5 can be achieved in this compact unit. AHdir^^ ffip, f^j^^itiil i 
c amera_accessQrtt. 42^€ywH»iB«£lGr-4^mpletes the pack- 
age. The only thing not incorporated into this unit is a 65 
CD/DVD drive and therefore downloads of the tours from 
the user's PC (FIG. 1) are generally required to use this unit. 
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The system unit S3 is shown in more detail in FIG. 6. The 
system unit includes a CPU 601 connected by a back-side 
bus 602 to a Level 2 cache RAM 603. The CPU 601 is also 
connected by a front-side bus 604 to a direct memory access 
(DMA) control chip 605 to which to which main system 
RAM 606 is connected by memory bus 607 and AGP video 
controller 608 is connected by AGP bus 609. The AGP video 
controller is connected to a video bus 610 which connects to 
the display 52 via a video frame buffer 611. The DMA 
control chip 605 is connected by a PCI (Peripheral Com- 
ponent Interconnect) bus 612 to an I/O control chip 613. The 
I/O control chip 613 supports an internal hard drive 614, a 
CD/DVD drive 615 and various ports, including an IEEE 
1394 port 616, one or more USB ports 617, an IR port 618, 
and a wireless RF port 619, such as for the Bluetooth 
standard. One or the other of these ports may be used to 
provide a connection to the user's PC (FIG, 1) to download 
a selected tour to the hard drive 614 or a connection to the 
optional digital camera 57 for accessing the GIS database on 
hard drive 614 and/or CD/DVD drive 615 in order to 
identify subject(s) of digital video image(s) or video clip(s). 
Operating system (OS) software is installed on the hard 
drive 614. Voice recognition and speech synthesis software 
are also installed on the hard drive 614. The I/O control chip 
613 additionally provides support for a modem 620 which 
connects to the wireless mobile telephone 44 and an audio 
chip 621 that connects to a microphone 623 and a speaker 
624. The microphone 623 could be integrated into the 
display 52, and the speaker 624 could be integrated into the 
system unit 53. An audio jack 625 is provided in the system 
unit 53 in order to plug the optional headset 58 into the 
system unit. Hie jack 625 disables the integrated micro- 
phone and speaker when the headset 57 is plugged into the 
system unit. Optionally, a low power RE transmitter 626 
may be used to transmit to a radio in an automobile in order 
to use the automobile's speaker system. The controls 522 to 
526 on the display 52 are also connected to the I/O control 
chip 613. These controls 522 to 526 provide only minimal 
control functions since most of the computer/user interface 
is supported by the voice recognition software and speech 
synthesis software. The display 52 could additionally incor- 
porate functions of a personal digital assistant (PDA) in 
which a stylus is used to access an address book, a reminder 
list, a calculator and the like from one or menus and to input 
written data using the handwriting recognition function of 
the PDA function. As mentioned, the display 52 could be the 
PDA 40 shown in FIG. 4. 

Since it is contemplated that the interactive multimedia 
tour guide will be used in countries where the national 
language is not one in which the user is fluent, the interactive 
multimedia tour guide may include language translation 
software allowing the user not only to select a preferred 
language with which to communicate with the interactive 
multimedia tour guide but also to provide translations of 
words and phrases. This can be done in various ways. First, 
the user can speak the command "TRANSLATE INTO 
ENGLISH" or "TRANSLATE INTO SPANISH", for 
example, followed by the word or phrase to be translated. 
The translated word or phrase can be generated by the 
speech synthesis software and, optionally, displayed on the 
screen 521 of the display 52. Alternatively, if the display 
incorporates a PDA function, the word to be translated can 
be written with the stylus using the graffiti convention of the 
PDA function after first selecting a translate function and 
language from a menu displayed on the screen 521, 

FIG. 7 illustrates the relationship of the portable self- 
contained electronic system implementing the interactive 



07/14/2004, EAST Version: 1.4.1 



us 6,526351 B2 



17 



18 



multimedia tour guide according to the inveation with the 
GPS system and a wireless personal telephone communica- 
tion service, such a cell phone. The portable self-contained 
electronic system can be used in an automobile 701, by a 
user on a bicycle 702, or by a user on foot 703. The GPS $ 
system comprises a constellation of twenty-four satellites, 
twenty-one active satellites plus three on-orbit spares, trav- 
eling around 12-hour circular orbits 10,898 nautical miles 
above the earth. Each satellite includes a feedback control 
loop to maintain continuous earth-seeking orientation for jq 
twelve navigation antennas and another feedback control 
loop to maintain a similar sun -seeking orientation for its two 
solar arrays. Each of the active satellites transmit accurate 
timing pulses and satellite ephemeris constants which are 
used by receivers to determine where the satellite was when 15 
it transmitted the timing pulses. To determine its position, a 
GPS receiver, such as receiver 51, measures the signal travel 
times associated with the binary pulse trains from four of the 
satellites, shown in FIG. 7 as satellites 704, 705, 706, and 
707, The signal travel time multiplied by the speed of light 20 
equals the slant range from the satellite to the user. By 
measuring the instantaneous Doppler shift associated with 
those same four satellites, the receiver can also determine its 
three mutually orthogonal velocity components. 

Cellular telephone systems have advanced from analog 
systems to digital systems, the latter implementing a code 
division, multiple access (CDMA) protocol which provides 
increased capacity. In a CDMA system, the propagation of 
a wideband carrier signal is used. Wideband signal trans- 
mission also offers the advantages of reducing fade and 
avoidance of jamming. The Federal Communications Com- 
mission (FCC) issued a Notice of Inquire (NOI) in 1991 into 
how to develop and implement a new personal communi- 
cations service (PCS). This may lead to yet more advanced 
mobile telephone communications systems. One area being 
developed is a land-mobile-to-satellite communications sys- 
tem which has the advantage of not requiring an array of 
land-based base transceivers but with the disadvantages 
associated with satellite communications, including rela- 
tively high-powered mobile transceivers. The present inven- 
tion contemplates the use of a wireless mobile telephone 54, 
and current technology in widest use is the cellular tele- 
phone system. In such a system, the telephone 54 commu- 
nicates with one or more transceivers 708 mounted on 
towers 709, each of these transceivers providing coverage 
within a cell and connecting calls to land lines 710 to 
telephone exchange ofi&ces 711. The specific technologies 
used either for determination of location (e.g., the GPS 
system) or communication (e.g., a cellular telephone 
system) are not critical to the practice of the invention. These 
current technologies, however, represent the preferred tech- 
nological environment in which to practice the invention. 

Timing now to FIGS. 8A to 8C, the flow diagram 
illustrates the process of taking a selected tour whidi has 
been down loaded from the user's personal computer (FIG. 
1) to the portable self-contained electronic system (FIGS. 5 
or SA) or, in the alternative, taking a tour generated directly 
on the portable self-contained electronic system, implement- 
ing the interactive multimedia lour guide according to the 
invention. The process begins in FIG. 8A by obtaining the 60 
current location from the GPS receiver 51 in function block 
801. This might be initiated automatically upon power on 
and/or pressing the location switch 522 on the display 52. 
Tliere typically is a short period of time for the acquisition 
of signals from four GPS satellites (FIG. 7), but when these 65 
signals are acquired, the current location of the GPS 
receiver, and hence the user, is quickly computed. The tour 
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Stored on the hard drive 613 is accessed in function block 
802. A determination is made in decision block 803 as to 
whether there is a current tour in progress. For example, if 
during a tour the user decides to stop to have limch or 
independently explore an area not part of the selected tour, 
the user may mm off the portable self-contained electronic 
system implementing the interactive multimedia tour guide 
according to the invention. As part of the power down 
process, the system stores the current status of the tour so 
that it may be later resiuned. If there is a current tour in 
progress, as determined in decision block 803, the status of 
the tour at the time it was suspended is accessed in function 
block 804, and the user's current location is used in function 
block 805 to determine directions to resume the tour. If this 
is the beginning of the selected tour, again as determined in 
decision block 803, the user's current location is used to 
determine in function block 806 directions to the beginning 
of the tour. 

Once the user's current location is determined, a map 
showing the user's location relative to the first or next point 
of interest in the tour is displayed in function block 807. The 
user can use the zoom in/out wheel 525 to zoom in and out 
in the displayed map and can use the roller ball 526 to scroll 
the map vertically and horizontally. Alternatively, the user 
can voice the commands "ZOOM" or "PAN'* followed by 
the direction to accomplish the same purpose, such as 
"ZOOM RV* or "ZOOM OUT" and "PAN RIGHT" or 
"PAN UF', etc. Ordinarily, this will not be necessary, at least 
for the initial map display. The directions are provided in 
audio/visual form in function block 808. The audio form of 
the directions are verbal directions generated by the speech 
synthesis program triggered by location and proximity to a 
turn or landmark. The visual directions, in addition to the 
displayed map, are in the form of an arrow pointing up for 
straight ahead or left or right, indicating a turn at the next 
intersection. 

Along the route to the next principle point of interest, the 
user's current location is constantly being updated by infor- 
mation fifom the GPS receiver 51. This is shown at input 
block 809 in FIG. 8B. The location information is used in 
function block 810 to access the GIS database downloaded 
from the user's personal computer for the selected tour or 
stored on the portable self-contained system of RG. 5. This 
database includes the custom set of ancillary points of 
interest generated using the composite preference mask. The 
user's approach to one of these anciUary points of interest 
will be detected in decision block 811 which triggers the 
speech synthesis software with text to speech module to 
generate an audible description of the ancillary point of 
interest in function block 812. If the user finds the ancillary 
point of interest of more than passing interest and feeLs that 
he or she has the time to deviate from the main tour, the user 
may want to visit this point of interest. The user may voice 
the command "DIRECTIONS". If that command is voiced, 
as determined in decision block 813, the system accesses the 
GIS database to determine the directions to this ancillary 
point of interest and provides the directions in audio/visual 
form in function block 814. After visiting die ancillary point 
of interest, the user may then voice the command "RESUME 
TOUR". This conmiand is detected in decision block 815 
and, until the command is detected, the system waits in 
function block 816. When the "RESUME TOUR" command 
is detected in decision block 815, the process loops back to 
function block 801 in FIG. 8A, and the system then provides 
the directions in audio/visual form in function block 808 to 
gel back to the main tour. 

If an ancillary point of interest is not detected in decision 
block 811, a determination is made in decision block 817 as 
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to whether a principle point of interest is close. If not, the as provided by the GPS receiver 51 in input box 902 to 

process loops back to input block 809. On approach to a access the database to determine in function block 903 the 

principle point of interest on the selected tour, as determined closest dining facilities. These may be of different categories 

by location information provide by the GPS receiver 51 and from fast food to haute cuisine, depending on the custom set 

detected in decision blodc 817, the process goes to function 5 of ancillary points of interest generated by the composite 

block 818 in FIG. 8C where system accesses the database to preference mask. If there are different categories, the system 

generate an audioMdeo presentation for the principle point prompts the user to select a category in function block 904. 

of interest. The audioA^ual presentation provides the user The categories might be "fast food", "casual" or "formal" 

with a preview of what he or she is about to experience. The and these categories are spoken by the speech synthesis 

visual presentation, which may include video clips, can be software as, "Do you want fast food, casual or formal?" The 

inhibited while the automobile is in motion. A determination user responds by voicing one of the categories. A determi- 

is made in decision block 819 as to whether the automobile nation is made in decision block 905 whether the user's 

is in motion (assuming that the portable electronic system of response is fast food. If so, the choices, if any, of fast food 

FIG. 5 is in an automobile). The GPS receiver 51 establishments are announced in function block 906; 

determines, from Doppler frequency shifts, velocity com- ^5 otherwise, a determination is made in decision block 907 

ponents as well as location coordinates. If the automobile is whether the user's response is casual. If so, the choices, if 

not in motion, the audio/visual presentation is played in any, of casual dining establishments are announced in func- 

f unction block 820. The GIS database is accessed for the tion block 908; otherwise, a determination is made in 

principle point of interest to determine if this point of decision block 909 whether the user's response is formal. If 

interest has a Web site. If so, as determined in decision block 20 choices, if any, of formal dining establishments are 

821, the user will be asked in function block 822 whether he announced in function block 910; otherwise, the process 

or she wishes to access the Web site as part of his or her waits in function block 911 before looping back to decision 

preview of the point of interest. If the user's response is block 905 to await the user's response. In each of function 

YES, as determined in decision block 823, the system blocks 906, 908 and 910, the user is prompted to make a 

activates the modem 517 and dials the user's ISP through the 25 choice if any are provided. 

wireless mobile telephone 54. Depending on where the tour Referring now to FIG. 9B, and assuming first that the user 

is relative to the user's home, it may be necessary to include has chosen a formal dining establishment, the database is 

in the downloaded database local phone numbers in the checked in decision block 912 to determine if reservations 

vicinity of the tour in order to access the user's ISP using a are required or recommended. If so, the user is prompted in 

local number. Once a connection is made, the principle point 30 function block 913 of the requirement and asked whether a 

of interest's URL is input in function block 824 to access the call should be placed to the establishment. If the user voices 

Web site. The roller ball 526 on the display 52 may be used the command "CALL", as determined in decision block 914, 

to navigate the Web site. When the user has finished viewing the system accesses the establishment's telephone number 

the Web site, the user may voice the command "SIGN OFF", from the database and dials the telephone 54 in function 

When this command is detected, as determined in decision 35 block 915. Once the connection is made, the user can 

block 825, the system logs off and disconnects from the identify himself or herself and make the necessary reserva- 

Internet; however, until that command is voiced, the system tions. If reservations are not required, as determined in 

waits in function block 826. decision block 912, or the user declines to call for 

If the automobile is in motion, as determined in decision reservations, as determined in decision block 914, or after 

block 819, only the audio portion of the audio/visual pre- 40 the call is made, a determination is next made in decision 

sentation is presented in function block 826. Moreover, there block 916 as to whether the selection is acceptable. For one 

is no access to the principle point of interest's Web site, if reason or another, the user may decide that the selection is 

any. After making the audio/visual presentation and option- not acceptable, perhaps he or she may not have been able to 

ally accessing the Web site, if any, or after playing only the obtain reservations. The user is given the option in decision 

audio portion of the presentation, the process reminds the 45 block 917 to review the choices. If the user chooses this 

user to resume the tour on return and then enters a suspended option, the process loops back to function block 903 in FIG. 

operation. While in this suspended operation, a check is 9A. However, should the user not find the selection accept- 

made in decision block 828 as to whether the user has voiced able and does not choose to review the choices, a return is 

the command "RESUME TOUR". If not, the process con- made to the main program in return block 918. If the 

tinues to wait in function block 829. However, when the 50 selection is acceptable, as determmed in decision block 916, 

"RESUME TOUR" command is detected in decision block or a choice of a fast food establishment is made in response 

828, a further test is made in decision block 830 to determine to the prompt in function block 906 or a choice of a casual 

if the last principle point of interest for the current selected food establishment is made in response to the prompt in 

tour has been visited. If not, the process returns to function function blodc 908, directions to the selected dining estab- 

block 801 in FIG. 8A and the main process flow. If the last 55 lishment are generated in function block 919 along with an 

point of interest of the cunent selected tour has been visited, estimated time of arrival. The audioA'isual directions are 

directions to the end of the tour are generated in function generated in function block 920. Upon arrival at the dining 

block 831 before the process ends. The end of the tour may establishment, the process ends or suspends, 

be the user's home, a bed-and-breakfasl, etc. If the voiced command detected is not "DINING" as 

If at any time during the tour the user would like to deviate 60 determined in decision block 901 in FIG. 9A, the process 

from the tour, such as find a nice inn or restaurant for lunch goes to decision block 921 in FIG. 9C where a determination 

or dinner or perhaps locate lodging at a bed-and-breakfast or is made as to whether the voiced command is "LODGING", 

motor lodge or perhaps a campground, this can be accom- If so, the system uses the current location as provided by the 

phshed by the process shown in FIGS. 9 A to 9D. Referring GPS receiver 51 in input box 922 to access the database to 

first to FIG. 9A, should the user voice the command 65 determine in function block 923 the closest lodging facih- 

"DINING"(or like command, such as "FOOD"), as detected ties. These may be of different categories from mstic to 

in decision block 901, the system uses the current location luxurious, depending on the custom set of ancillary points of 
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interest generated by the composite preference mask. If there 
are different categories, the system prompts the user to select 
a category in function block 924. The categories might be 
"bed-and*breakfast" "motor lodge" or "campground" and 
these categories are spoken by the speech synthesis software 
as, "Do you want bed-and-breakfast, motor lodge or camp- 
ground?" The user responds by voicing one of the catego- 
ries. A determination is made in decision blodc 925 whether 
the user's response is bed-and-breakfast. If so, the choices, 
if any, of bed-and-breakfast estabUshments are announced in 
function block 926; otherwise, a determination is made in 
decision block 927 whether the user's response is motor 
lodge. If so, the choices, if any, of motor lodges are 
announced in function block 928; otherwise, a determination 
is made in decision block 929 whether the user's response is 
campground. If so, the choices, if any, of campgrounds are 
announced in function block 930; otherwise, the process 
waits in function block 931 before looping back to decision 
block 925 to await the user's response. In each of function 
blocks 926, 928 and 930, the user is prompted to make a 
choice if any are provided. 

Referring now to FIG. 9D, the user is asked in function 
block 936 whether a call should be placed to the establish- 
ment to make reservations. If the user voices the oonnnand 
"CALL", as determined in decision block 937, the system 
accesses the establishment's telephone number from the 
database and dials the telephone 54 in function block 938. 
Once the connection is made, the user can identify himself 
or herself and make the necessary reservations. If the user 
declines to call for reservations, as determined in decision 
block 937, or after the call is made, a determination is next 
made in decision block 939 as to whether the selection is 
acceptable. For one reason or another, the user may decide 
that the selection is not acceptable, perhaps he or she may 
not have been able to obtain reservations. Tht user is given 
the option in decision block 940 to review the choices. If the 
user chooses this option, the process loops back to function 
block 923 in FIG. 9C. However, should the user not find the 
selection acceptable and does not choose to review the 
choices, a return is made to the main program in return block 40 
941. If the selection is acceptable, as determined in decision 
block 939, directions to the selected lodging establishment 
are generated in function block 942 along with an estimated 
time of arrival. The audio/visual directions are generated in 
function block 943. Upon arrival at the lodging 45 
establishment, the process ends or suspends. 

FIGS. lOAto lOD, taken together, show the flow diagram 
of the process implemented for the optional digital camera 
57 (FIG. 5) or the camera accessory 42 (FIG. 4) if used on 
the system shown in RG. 5A. In the this process, the 
camera, which may be either a still camera or a video 
camera, can be either in commtmication with the system unit 
53 (FIG. 5) or not. In the former case, identification and 
description information is contemporarily stored with the 
images or video clips, whereas in the latter case, identifica- 
tion and description information is added in a later process 
with the system unit. While communication between the 
camera 57 and the system unit 53 can be accomplished by 
means of a cable connection, this is generally not desirable. 
In the preferred embodiment, a wireless connection between 
the camera 57 and the system unit 53 is made using, for 
example, the Bluetooth standard. The particular wireless 
standard used, however, is not critical to the practice of the 
invention. Typically, the camera 57 will be in communica- 
tion with the system unit 53 when the user is a pedestrian or 
bicyclist wearing the carrying case 56 as a backpack or 
fannypack. In this situation, the camera 57 and the system 
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imit 53 will be in close proximity, facilitating the wireless 
communication link between the two. If the portable elec- 
tronic system is being used in an automobile, the portable 
electronic system will remain in the automobile while pic- 
tures are being taken and, depending on the distance of the 
camera 57 from the system unit 53, the camera 57 may lose 
its communication link with the system unit 53. The camera 
57 includes a calendar/clock which is used to date and time 
stamp digital image(s) or video clips. In addition, the camera 
57 is preferably equipped with its own GPS receiver so that 
location information can be stored with digital iraagc(s) or 
video clips. In other words, the camera 57 does not have to 
rely on the location information from GPS receiver 51, 
which is important if the communication link between the 
camera 57 and the system unit 53 is broken. One additional 
piece of information, is also required for one feature of the 
invention and that is orientation information. For this, the 
digital camera is equipped with a digital magnetic compass. 
Thus, when pictures or video clips are taken with the 
camera, information on the orientation of the camera is also 
stored with the digital image(s) or video clips. If the optional 
implementation shown in FIG. 5Ais used, a communication 
lii^ will always be maintained since the units are integral. 

Referring first to FIG. IDA, the process begins in function 
block 1001 when the camera is activated. As the camera is 
activated, either by releasing the shutter if a still camera or 
by triggering the camera on if a video camera, date and time 
information are automatically stored with the digital image 
(s) in function block 1002. Location information is also 
available from the camera's GPS receiver, and this infor- 
mation is also stored with the digital image(s) in function 
block 1003. In many cases, this location information is 
enough to make an accurate determination of the subject of 
the picture or video clip, but additional information is often 
required to make a more accurate determination and that is 
supplied by orientation information. This information is 
supplied by the built-in digital compass in the camera. The 
orientation of the camera is therefore recorded with the 
digital image(s) in function block 1004, A determination is 
made in decision block 1005 as to whether the camera is 
currently in communication with the system unit. If not, the 
process goes to FIG. IOC, described below. However, if the 
camera is currently in communication with the system unit, 
the GIS database stored on the hard drive of the system unit 
53 is accessed in function block 1006, and a tentative 
determination of the likely subject of the digital image(s) or 
video clip is made in function block 1007. This system then 
activates the speech synthesizer and audibly armounces to 
the user the subject tentatively determined in function block 
1008. 

The process next goes to FIG. lOB where the user is 
prompted for confirmation of the tentative identification of 
the subject of the digital image or video clip in function 
block 1009. The user confirms by voicing "OK" or declines 
to confirm by voicing "NO". If the user voices "OK", as 
determined in decision block 1010, the subject information, 
including a brief description stored in the GIS database, is 
stored with the digital image(s) or video clip in function 
block 1011 along with the date, lime, location and orienta- 
tion information. However, should the user decline to con- 
firm the determined subject, the user is audibly prompted to 
provide a verbal identification and brief description of the 
subject in function block 1012. A determination is made in 
decision block 1013 as to whether the user has supplied the 
identification and description information and, iif not, the 
process waits in function block 1014. When the user has 
finished speaking the identification and description 
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informatioQ, as determined in decision block 1013, the user 
supplied identification and description information is stored 
with the digital image(s) in function block 1011. Next, a 
determination is made in decision block 1015 as to whether 
the user has turned the camera off If so, the process ends; 
otherwise, the process loops back to function block 1001 in 
FIG. lOA to await the next activation of the camera. 

Assuming next that the camera 57 is not currently in 
communication with the system unit 53, as detected in 
decision block 1005 in FIG. lOA, the process goes to 
function block 1016 in FIG. IOC where digital images or 
video clips are accumulated with locatioo and orieatation 
information. A determination is made in decision block 1017 
as to whether communication has been reestablished with 
the system unit and, if not, the process loops back to function 
block 1016 to continue accumulating digital images or video 
clips. However, once communication is re-established it is 
possible to access the GIS database on the hard drive of the 
system unit. The next step in the process in function block 
1018 is to access the next digital image or video clip in the 
order accumulated in function block 1016. The GIS database 
is accessed in function block using the location and orien- 
tation information stored with the digital image or video clip 
in function block 1019 to identify the probable subject of the 
digital image or video clip. A tentative identification of the 
subject is made in function block 1020. The system then 
activates the speech synthesizer and audibly announces to 
the user the first subject determined in function block 1021. 

Ibe process next goes to function block 1022 in FIG. lOD 
where the user is prompted for confirmation. The user 
confirms by voicing "OK" or declines to confirm by voicing 
"NO", If the user voices "OK", as determined in decision 
block 1023, the subject information, including a brief 
description stored in the GIS database, is stored with the 
digital image or video clip in function block 1024 along with 
the date, time, location and orientation information. 
However, should the user decline to confirm the determined 
subject, the user is audibly prompted to provide a verbal 
identification and brief description of the subject in function 
block 1025. A determination is made in decision block 1026 
as to whether the user has supplied the identification and 
description information and, if not, the process waits in 
function block 1027. When the user has finished speaking 
the identification and description information, as determined 
in decision block 1026, the user supplied identification and 
description information is stored with the digital image(s) in 
function block 1024. A determination is then made in 
decision block 1028 as to whether all digital image(s) or 
video clip(s) have been processed. If not, the proce.ss loops 
back to function block 1018 in FIG. IOC to process the next 
digital image or video clip. When all digital image(s) or 
video clip(s) have been processed, a determination is made 
in decision block 1029 as to whether the user has turned the 
camera off and, if so, the process ends; otherwise, the 
process loops back to function block 1001 in FIG. lOA. 

In alternative embodiments, the digital camera may not 
have a built-in GPS receiver and may instead rely on the 
GPS receiver 51, but this can only be done when the camera 
is auached to the system unit 53. While it is preferable to 
provide contemporary identification of the subjects of digital 
images or video clips which are fresh in the user's memory, 
the user may be given the opportunity to delay the identi- 
fication process until sometime later, if it is more convenient 
to do so. The digital image(s) can be stored internally in the 
camera using the camera* s internal memory device (memory 
stick, tape, etc.) or uploaded to the hard drive in the system 
unit 53. Once the user has returned home for his or her tour, 



10 



15 



20 



25 



30 



35 



45 



50 



55 



60 



65 



it now becomes an easy matter to upload the stored images 
and/or video clips to the user's PC for purposes of archiving 
and presentation. A link can be provided for standard video 
editing software, such as Adobe Premiere'™ video editing 
software, to provide date, time and identification informa- 
tion for images and video clips. 

While the invention has been described in terms of 
preferred embodiments, those skilled in the art will recog- 
nize that the invention can be practiced with modification 
within the spirit and scope of the appended claims. In 
particular, it will be recognized that the preferred embodi- 
ments may, with improvements in technology, be modified 
to be more compact, capable of storing larger databases and 
including more integrated functions. 

Having thus described my invention, what I claim as new 
and desire to secure by Letters Patent is as follows: 

1. An interactive multimedia tour guide comprising: 

a Geographic Information System (GIS) database of pack- 
aged tours from which a user may select a tour, each 
tour being comprised of principle points of interest and 
ancillary points of interest, the ancillary points of 
interest not being the primary subject of a particular 
tour, and 

a portable self-contained system including a Global Posi- 
tioning Satellite (GPS) receiver and means for storing 
at least a selected tour and related information from the 
GIS database, the portable self-contained system fur- 
ther including a speedi synthesis function to provide 
audible directions and information about points of 
interest as a tour progresses and audible prompts to the 
user, the GPS receiver generating location information 
used to access information in the selected tour, the 
interactive multimedia tour guide allowing the user to 
modify the selected tour while in progress. 

2. The interactive multimedia tour guide recited in claim 

1, further comprising means for accessing an Internet Web 
site and updating information for a selected toiu^ from the 
Internet Web site. 

3. The interactive multimedia tour guide recited in claim 

2, wherein the means for accessing an Internet Web site 
accesses Web sites, if any, of at least principle points of 
interest in the selected tour. 

4. The interactive multimedia tour guide recited in claim 
2, wherein the means for accessing an Internet Web site 
accesses a Web site of a provider of the GIS database. 

5. The interactive multimedia tour guide recited in claim 
1, further comprising a user preference mask applied to a 
selected tour to select those ancillary points of interest in the 
selected tour which may be of the most interest to a user to 
generate a customized tour for the user, 

6. The interactive multimedia tour guide recited in claim 
1, further comprising means for previewing one or more 
packaged tours in the GIS database, a preview of a packaged 
tour including an audio/visual presentation of at least the 
principle points of interest in a packaged tour. 

7. The interactive multimedia tour guide recited in claim 
6, further comprising selection means allowing a user to 
select principle points of interest from two or more packaged 
tours to generate a custom tour. 

8. The interactive multimedia tour guide recited in claim 
6, further comprising a user preference mask applied to a 
selected tour to select those ancillary points of interest in the 
selected tour which may be of most interest to a user to 
generate a customized tour for the user. 

9. The interactive multimedia tour guide recited in claim 
1, further comprising: 

a user preference mask and a travel companion preference 
mask; 
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a combining function for combining the user preference a speech synthesis function controlled by The CPU to 

mask and the travel companion preference mask to provide audible directions and information about points 

generate a composite preference mask; and of interest as the selected tour progresses and audible 

means for applying the composite preference mask to a prompts to a user, M*erein the CPU is programmed to 

selected tour to select those ancillary points of interest S ^""w the user to modify the selected tour while m 

in the selected tour which may be of the most interest progress. 

to a user and travel companion to generate a custom- I}*' P"!^^]'' self-contamed interactive mulUmedia 

ized tour for the user and travel companion. 6^^^ »° cl*"™ 1*' comprismg a portable 

10. The interactive multimedia tour guide recited in claim telephone. 

I, further comprising a camera interfacing with the portable w 20. The portable self-contamed mteracUve multimedia 
self-contained system, the camera including means for gen- 8^!^^ ^^^^^ ^° "^^'^ 1'' therein the portable tele- 
erating orientation information and obtaining location Pl*""' "«=ludcs an mtegrated Personal Digital Assistant 
information, the camera date and time stamping images and (PDA) and the tour guide and portable telephone are housed 
providing orientation and location information for images, ^ ^ unitary structure. 

the orienUtion and location informatfan being used to access 15 21. The portable self-contamed interactive multimedia 

related infonnation from the GIS database to identify a 8"^'^^ "^'^^^ 20, further comprising a camera 

probable subject of an image. attachment for atUching to said unitary structure, the display 

11. The interactive multimedia tour guide recited in claim «="™g " ^e™. fi°der for the camera attachment when 
10, further comprising means prompting a user to confirm an attached to the unitary structure. 

identified probable subject of an image. M 22. Tie portable self-ooniamed interactive multimedia 

U. The interactive multimedu tour guide recited in claim ^ur guide recited in claim 21, wherem the camera attach- 

II, wherein the user is prompted to identify the image if the mentincludes means for generaung onentation informaUon, 
identified probable subject of the image is not confirmed. usmg the orientation information from the camera 

13. The interactive multimedia tour guide recited in claim "taf hment and location mfotmation firom the GPS system 
1, wherein the portable self-contained system further « for images taken by the Mmera attachment to acces 
includes a portable telephone operable in response to voice mformaUon from the GIS database to identify a probable 
commands. subject of animage. . , . . ^. „. 

14. The interactive multimedia tour guide recited in claim 23- P°^^]^. self-«)ntain«l interactive mulUmedia 
13, wherein related information from the CIS database to"' P"de recited m chum 22 further comprismg means 
includes Universal Resource Lxjcators (URLs) for at least 30 promptmg a user to confirm an idenUfied probable subject of 
the principle points of interest of a selected lour, the portable animage. , . ... . . • j. 

self-contained system prompting a user on approach to a 24. THe portoble self-conUmed interactive mulUmedia 

point of interest as determined from location information 'o"' g^.^^ « «ted m chim 23. wherem the user is prompted 

generated by the GPS receiver whether to access an Internet ^ «dentify the image if the identified probable subject of the 

Web site of the point of interest and, if the user enters a 3S ™ff i^^"* confirmed 

command to access the Web site, accessing the Web site 25. The portable self-contamed interactive mulUmedia 

using the portable telephone. 1°"' guide recited in claim 19, wherem related information 

15. The interactive multimedia tour guide recited in claim &om the GIS database includes Universal Resource Loca- 
1, fiirther comprising a voice recognition function which l^^f , Pfin«Ple pointf of ^terest of a 
responds to voiced commands from the user. "o s^'^'^'cd tour, the portable self-contamed multimedia tour 

16. The interactive multimedia tour guide recited in claim S"^^^ prompting a user on approach to a pomt of mterest as 
15, v^erein the related infonnation from the GIS database determined from location information generated by the GPS 
indudes amenities, the voice recognition function respond- «<=eiver whether to access an Internet Web site of the point 
ing to a voiced command from a user to locate a place to eat °^ if the user enters a command to access the 
by searching the amenities inchided in the related informa- « Web site, accessmg the Web site using the portable tele- 
tion to identify proximate places to cat. P^'i^ .„ ., ,r - , - , • 

17. The interactive multimedia tour guide recited in claim 26. The portable self-contamed mteracUve multimedia 
15, wherein the related information from the GIS database ""ur guide recited in claini 18, furtiier comprismg a voice 
includes amenities, the voice recognition function respond- recognition function which responds to voiced commands 
ing to a voiced command from a user to locate a place to sUiy SO . .... ., ..... 

by searching the amenities included in the related informa- 27. The interactive inultimedia tour guide recited in claim 

tion to identify proximate places to stay. 26. wherem the related informauon from the GIS database 

18. A portable self-contained interactive multimedia tour incl"dw amenities, the tour guide responds to a voiced 
Euide comprising- command from a user to locate a place to eat by searching 

... ... I.J. c ss the amenities included in the related information to identify 

means for stormg at least a selected tour from a Geo- roximate laces to eat 

graphic Information System (GIS) database of pack- ^'^^^^ L^a'clive m^^^ 

aged tours, the selected lour being comprised of prm- ^^^^^ ^^j^^^^ information from the GIS database 

ciplc points of interest and anciUary pomts of mtcrcst, ^^^^^^^ ^^^^ .^^ ^ ^^.^^ 

the ancillary points of mterest not bemg the pnmary ^^^^^^ ^ ^ ^^^J^ ^^^^^ ^^^^^^^ 

subject ot tne selected lour, amenities included in the related information to identify 

a Global Positioning Satellite (GPS) receiver generating proximate places to stay. 

location information; 29. A method of providing tours for use in an interactive 

a central processing unit (CPU) receiving said location multimedia tour guide comprising the steps of: 

information and accessing said GIS database; 55 generating a Geographical Information System (GIS) 

a display controlled by the CPU to display a map showing database containing packaged tours torn which a user 

a current location relative to the selected tour, and may select a tour, each tour being comprised of prin- 
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ciple points of inierest and ancillaiy points of interest, 
the ancillary points of interest not being the pi subject 
of the selected tour, 

prompting a user to preview one or more packaged tours 
in the GIS database, a preview of a packaged tour 
including an audioA^isual presentation of at least the 
principle points of interest in a packaged tour, and 

allowing a user to select principle points of interest from 
two or more packaged tours to generate a custom tour. 

30. The method of providing tours for use in an interactive 
multimedia tour guide recited in claim 29, further compris- 
ing the steps of: 

generating a preference mask for the user; and 
applying the preference mask to a selected tour to select 
those ancillary points of interest in the selected tour 
which may be of the most interest to a user to generate 
a customized tour for the user. 

31. The method of providing tours for use in an interactive 
multimedia tour guide recited in claim 29, further compris- 
ing the steps of: 

generating preference masks for the user and a travel 
companion; 

combining the preference masks of the user and the travel 
companion using a combining function to generate a 
composite preference mask; and 

applying the composite preference mask to a selected tour 
to select those ancillary points of interest in the selected 
tour which may be of the most interest to the user and 
the travel companion to generate a customized tour. 

32. The method of providing tours for use in an interactive 
multimedia tour guide recited in claim 29, further compris- 
ing the steps of: 

accessing a Web site; and 

updating information for the selected tour from the Web 

site. 

33. The method of providing tours for use in an interactive 
multimedia tour guide recited in claim 32, wherein the step 
of accessing a Web site includes accessing Web sites, if any, 
of at least the principle points of interest in a selected tour. 

34. The method of providing tours for use in an interactive 
multimedia tour guide recited in claim 32, wherein the step 
of accessing a Web site includes accessing a Web site of a 
provider of the GIS database. 

35. The method of providing tours for use in an interactive 
multimedia tour guide recited in claim 29, wherein the GIS 
database is Global Positioning Satellite (GPS) enabled and 
further comprising the steps of: 

accessing information for the selected tour in the GIS 
database using GPS generated location information; 

providing audible directions and information about points 
of interest as the tour progresses; and 



allowing the user to modify the selected tour while in 

progress. 

36. The method of providing tours for use in an interactive 
multimedia tour guide recited in claim 35, further compris- 
ing the steps of 

receiving orientation and location information from a 
camera; 

accessing information for the selected tour in the GIS 
database using the orientation and location information 
from the camera; and 
determining a probable subject of an image. 

37. The method of providing tours for use in an interactive 
multimedia totir guide recited in claim 36, further compris- 
ing the step of prompting a user to confirm an identified 
probable subject of an image. 

38. The method of providing tours for use in an interactive 
multimedia tour guide recited in claim 37, further compris- 
ing the step of prompting the user to identify the image if the 
identified probable subject of the image is not confirmed. 

39. The method of providing tours for use in an interactive 
multimedia tour guide recited in claim 35, wherein the 
information for the selected tour in the GIS database 
includes amenities and further comprising the steps of: 

responding to a voiced command for food or lodging by 
accessing the amenities information for the selected 
tour in the GIS database using GPS generated location 
information; and 
providing information on locations of places where food 
or lodging may be obtained. 

40. A camera comprising: 
means for recording an image, 

a Global Positioning Satellite (GPS) receiver for gener- 
ating location information at a time when the image is 
recorded; 

a digital compass for generating orientation information at 

the time when the image is recorded; 
a Geographic Information System (GIS) database storing 

points of interest; and 
database search means for searching the GIS database 
tising said location and orientation information gener* 
ated at the time when the image is recorded to identify 
a probable subject of the image. 

41. The camera recited in claim 40, further comprising 
means prompting a user to confirm an identified probable 
subject of an image. 

42. The camera recited in claim 41, wherein the tiser is 
^0 prompted to identify the image if the identified probable 

subject of the image is not confirmed. 
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